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(57) For an optimization system, which employs a 
genetic algorithm to calculate an optimal parameter that 
matches an evaluation condition consisting of multiple 
conditions, multiple GA engines 1 are provided at mul- 
tiple stages, from the lowermost to the topmost, and em- 
ploy a genetic algorithm to output, as gene groups PGn 
(n = 1 to N), parameter candidates that match evaluation 
conditions that are individually set for the stages. Each 



of gene migration controllers 2 moves specific genes be- 
tween a lower gene group PGn and a higher genre 
group PGn+1 . A convergence detennination unit 3 de- 
tennlnes the convergence of an optimization based on 
a gene group PGN calculated by the GA engine 1 at the 
highest stage. In order to set the evaluation conditions 
for the stages, conditions are added stepwise from the 
lowennost to the topmost stage. 
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Description 

[0001] The present Invention relates to an optimiza- 
tion system for using a genetic algorithm to obtain an 
optimal parameter for an optimization problem, and re- s 
lates in particular to an optimization system for employ- 
ing a stepwise evolution method to obtain an optimal pa- 
rameter that matches an evaluation condition consisting 
of multiple conditions. 

[0002] For various technical fields, requests exist for 
the quick and precise resolution of optimization prob- 
lems. An optimization problem consists of the acquisi- 
tion, from among multiple element combinations (pa- 
rameter candidates), of a combination (an optimal pa- 
rameter set) of optimal elements with which a desired ^5 
objective can be achieved under a predetermined eval- 
uation condition. An example optimization problem is 
one associated with how various circuits should be com- 
bined to constitute an electric circuit having a desired 
characteristic, one associated with how the operations 
of legs should be combined in order to most efficiently 
and naturally operate a walking robot, or one associated 
with how points making up a traffic network should be 
combined In order to optimize a goods delivery route. 
[0003] Recently, attention has been drawn to a genet- 
ic algorithm (hereinafter referred to, as needed, as a 
"GA") as a method for a parameter search for an opti- 
mization problem. As the generation of a solution 
evolves, a genette algorithm changes parameter candi- 
dates and perfomis a parameter search in accordance 30 
with a genetic rule that is present In the living world. A 
parameter candidate represents a combination of ele- 
ments as an element array, like a chromosome comple- 
ment. Then, an operation (a GA operator) similar to a 
chromosome operation, such as a cross-over and a mu- 35 
tation, is performed for the array, as needed, and the 
array is selected in accordance with its fitness (evolution 
of a generation). When this operation is repeated for a 
number of generations, from among an enomnous 
number of variations of parameter candidates the pa- 40 
rameter that most closely matches a condition and a tar- 
get is obtained as an optimal parameter. 
[0004] An optimization method using a genetic algo- 
rithm that is based on an unbalanced evolution theory 
is disclosed in ^ 
[0005] JP-A- 9-251446 as a conventional technique 
for a genetic algorithm. Specifically, according to this 
method, a group having a high mutation rate is separat- 
ed from a group having a low mutation rate, and for each 
group, fission Is employed to generate from a parent so 
candidate a pair of child candidates. At this time, one 
child candidate is obtained by directly copying the par- 
ent candidate, and the constituents of the other child 
candidate become mutated based on either a high or 
low mutation rate. By repeating the evolution of gener- 55 
ations, a set of optimal parameters having various phe- 
notypes is generated for the group having a high muta- 
tion rate, and therefore, at the initial step of the gener- 



ation evolution, an optimal parameter candidate having 
a comparatively high fitness can be quickly acquired. 
Forthe group having a low mutation rate, a set of similar 
optimal parameters is fornied that are present around 
the periphery of the parent candidates that have been 
obtained that have the highest fitness. As a result, at the 
initial step, an efficient parameter search in global space 
and, at the mature step, a detailed vicinity search can 
be implemented at the same time. 
[0006] Further, a conventional technique that applies 
a comparatively simple genetic algorithm for various 
types of controllers is disclosed in JP-A-1 0-63306 or 
JP-A-5-241639. 

[0007] For most of the actual approaches employed 
forthe resolution of an optimization problem, an optimal 
parameter is obtained that totallymatches an evaluation 
condition (a compound condition), consisting of multiple 
conditions, or a new condition is added, as needed, by >^ 
referring to the optimization results orthe control results. 
However, when a compound condition Is provided at the 
same time at the initial optimization step, or when an- 
other evaluation condition is added to results that have 
already converged, it tends to be difficult for the conven- 
tional method to escape from a local minimum. There- 
fore, for an optimization problem conceming a compli- 
cated compound condition, a phenomenon (a so-called 
trap by a local minimum) occurs such that the calculation 
required for a parameter search is extremely slow, or Is 
completely hatted. 

[0008] To resolve this shortcoming, It is one objective 
of the present invention to provide an optimization meth- 
od using a genetic algorithm in order to reduce the prob- 
ability of a trap by a local minimum. 
[0009] It is another objective of the present invention 
to rapidly and efficiently calculate an optimal, high qual- 
ity parameter by using the optimization method. 
[0010] To achieve these objectives, according to a 
first aspect of the invention, an optimization system, 
which employs a genetfc algorithm to calculate an opti- 
mal parameter that matches an evaluation condition 
consisting of multiple conditions, comprises: 

multiple calculators, provided at multiple stages, 
from the lowermost to the topmost, for employing a 
genetic algorithm to output, as gene groups, param- 
eter candidates that match evaluation conditions 
that are individually set for the stages; 
controllers for moving specific genes between gene 
groups at a lower stage and at a higher stage; and 
a detennination unit for detemiining the conver- 
gence of an optimization based on a gene group 
calculated by the calculator at the highest stage, 

wherein, In order to set the evaluation conditions 
for the stages, conditions are added stepwise from the 
lowennost to the topmost stage. 
[0011] According to the first aspect. It is preferable 
that the evaluation condition consisting of multiple con- 
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ditions be divided stepwise, so that the evaluation con- 
ditions can be set for the stages, and that a condition 
set at a lower stage have a greater constraining force 
than a condition set at a higher stage. 
[0012] According to the first aspect of the invention, it 
is preferable that the controller pemnit adjacent calcula- 
tors to exchange part of a gene group. It is particularly 
preferable that Individual genes of each of the gene 
groups be evaluated based on a predetermined gene 
selection method, and that, of a specific gene group, a 
gene with a relatively high evaluation be moved to a 
gene group at a higher stage. In this case, while moving 
a gene to a higher stage, the controller may receive a 
gene from the higher stage and Insert the received gene 
Into the specific gene group. 

[0013] For the moving of genes to a higher stage, it is 
preferable that the controller evaluate part of the gene 
group based on a predetermined gene selection meth- 
od, and move a gene with a relatively low evaluation to 
a gene group at a lower stage. In this case, it is prefer- 
able that the controller, while moving a gene to a lower 
stage, receive a gene from a lower stage and insert the 
received gene Into the gene group. 
[0014] According to a second aspect of the Invention, 
provided is a controller that employs the optimization 
system of the first aspect to calculate an optimal control 
parameter and to control a target based on the control 
parameter. 

[0015] According to a third aspect of the invention, an 
optimization method, which employs a genetic algorithm 
to calculate an optimal parameter that matches an eval- 
uation condition consisting of multiple conditions, com- 
prises: 

a first step of dividing, stepwise, the evaluation con- 
dition consisting of multiple evaluation conditions, 
of setting the evaluation condition for each stage 
from the lowemnost to the topmost, and of employ- 
ing a genetic algorithm to Independently calculate, 
as gene groups, parameter candidates that match 
the evaluation condition at each of the stages; 
a second step of moving specific genes between 
gene groups at a lower stage and a higher stage; 
and 

a third step of detemnining the convergence of the 
optimization based on a gene group that matches 
the evaluation condition at the highest stage. 

[0016] In the third aspect of the invention, it is prefer- 
able that a condition set at a lower stage have a greater 
constraining force than a . condition set at a higher stage. 
[0017] According to the third aspect of the invention, 
it is preferable that, at the second step, part of a gene 
group be exchanged by adjacent gene groups . It is par- 
ticularly preferable that the optimization method further 
comprise a step of: 

evaluating individual genes of each of the gene 



groups based on a predetemnined gene selection 
method, and of moving, between specific gene 
groups, a gene awarded a relatively high evaluation 
value to a gene group at a higher stage. In this case, 
5 the second step may include a step of: 

while moving a gene to a higher stage, receiv- 
ing a gene from the higher stage and inserting 
the received gene Into the specific gene group. 

10 

[001 8] According to the third aspect, the second step 
may include a step of: 

evaluating genes of the gene group based on a pre- 
15 determined gene selection method, and moving a 
gene with a relatively low evaluation value to a gene 
group at a lower stage. In this case, it is preferable 
that the second step include a step of: 

20 while moving a gene to a lower stage, receiving 

a gene from a lower stage, and inserting the 
received gene into the gene group. 

[0019] According to a fourth aspect of the invention, 
25 provided is a program that is executed by a computer 
con-esponding to a calculator at the lowest stage and 
that executes an optimization method, whereby an eval- 
uation condition consisting of multiple conditions is di- 
vided stepwise, whereby the evaluation conditions thus 
30 obtained are set for calculators provided at stages so 
that stepwise the evaluation conditions can be added 
from the lowemnost to the topmost stage, and whereby 
the calculators employ a genetic algorithm to Independ- 
ently calculate, as gene groups, parameter candidates 
35 that match the evaluation conditions at the stages, the 
optimization method comprising: 

a first step of evaluating individual genes for each 
of the gene groups based on a predetennined gene 

40 selection method, and of moving, between specific 
gene groups, a gene awarded a relatively high eval- 
uation value to a gene group at a higher stage; and 
a second step of receiving a gene from the higher 
stage, and inserting the received gene into the spe- 

45 cific gene group. . 

[0020] Accordlngto afifth aspect of the Invention, pro- 
vided is a program that is executed by a computer cor- 
responding to a calculator at the topmost stage and that 

50 executes an optimization.method, whereby an evalua- 
tion condition consisting of multiple conditions is divided 
stepwise, whereby the evaluation conditions are set for 
calculators provided at stages so that stepwise the eval- 
uation conditions can be added from the lowermost to 

55 the topmost stage, and whereby the calculators employ 
a genetic algorithm to independently calculate, as gene 
groups, parameter candidates that match the evaluation 
conditions at the stages, the optimization method com- 
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prising: 

a third step of evaluating individual genes for each 
of the gene groups based on a predetemnined gene 
selection method, and of moving, between specific s 
gene groups, a gene with a relatively low evaluation 
value to a gene group at a lower stage; and 
a fourth step of, while moving the gene to the lower 
stage, receiving a gene from the lower stage, and 
Inserting the received gene into the specific gene io 
group. 

[0021] According to a sixth aspect of the invention, 
provided is a program that is executed by a computer 
corresponding to a calculator at the middle stage and is 
that executes an optimization method, whereby an eval- 
uation condition consisting of multiple conditions is di- 
vided stepwise, whereby the evaluation conditions thus 
obtained are set for calculators provided at stages so 
that stepwise the evaluation conditions can be added 20 
from the lowermost to the topmost stage, and whereby 
the calculators employ a genetic algorithm to independ- 
ently calculate, as gene groups, parameter candidates 
that match the evaluation conditions at the stages, the 
optimization method comprising: 25 

a first step of evaluating individual genes for each 
of the gene groups based on a predetemnined gene 
selection method, and of moving, between specific 
gene groups, a gene with a relatively high evalua- so 
tlon value to a gene group at a higher stage; 
a second step of receiving a gene from the higher 
stage, and inserting the received gene into the spe- 
cific gene group; 

a third step of evaluating individual genes for each 35 
of the gene groups based on a predetermined gene 
selection method, and of moving, between specific 
gene groups, a gene with a relatively low evaluation 
value to a gene group at a lower stage; and 
a fourth step of, while moving the gene to the lower 40 
stage, receiving a gene from the lower stage, and 
inserting the received gene Into the specific gene 
group. 

[0022] According to one of the fourth to sixth aspects, 45 
it is preferable that a condition set at a lower stage have 
a greater constraining force than a condition set at a 
higher stage. 

£0023] According to a seventh aspect of the invention, 
a computer-readable recording medium is provided on so 
which a program according to one of the fourth to the 
sixth aspects is stored. 

[0024] Fig. 1 is a block diagram showing the configu- 
ration of an optimization system. 

[0025] Fig. 2 Is a timing chart for the evolution of gen- ss 
orations. 

[0026] Fig. 3 is a flowchart showing the gene migra- 
tion processing. 



[0027] Figs. 4A and 4B are diagrams for explaining 
the relationship between the evolution generation and 
the optimization results. 

[0028] Fig. 5 Is a block diagram showing the configu- 
ration of a controller that Incorporates an optimization 
apparatus. 

[0029] Fig. 6 is a diagram for explaining a generated 

network for the walking pattern for one leg. 

[0030] Fig. 7 is a specific diagram showing a lower 

space. 

[0031] Fig. 1 is a block diagram showing the configu- 
ration of an optimization system according to a first em- 
bodiment of the present invention. The optimization sys- 
tem comprises N GA engines 1, (N-1) gene migration 
controllers 2, and a convergence determination unit 3, 
all of which constitute a distributed GA. The difference 
between this system and the common distributed GA is 
that the GA engines 1 are provided at multiple stages 
from the lowemiost to the topmost, and, as will be de- 
scribed later, an evaluation condition to be set for each 
GA engine 1 Is added stepwise from the lowermost to 
the topmost stage. The lowermost stage is defined as 
the first stage, succeeding stages are defined as the 

second, the third and the topmost stage Is defined 

as the n-th stage. The gene migration controllers 2 are 
located between adjacent GA engines 1 , and move, be- 
tween the immediately adjacent stages, genes in a gene 
group PGn (n = 1 to N) to be optimized. The conver- 
gence determination unit 3 accompanies only the top- 
most GA engine 1 , and detemiines the optimization con- 
vergence based on the gene group PGN output by the 
topmost GA engine 1 . 

[0032] The "topmost" stage is a target stage whereat 
an optimal parameter, whteh is the final target, may be 
included, i.e., a stage whereat all conditions are set that 
are finally to be provided. Therefore, the optimal param- 
eter finally sought by an operator, i.e. , a parameter that 
matches all the conditions that should be considered, Is 
calculated by the topmost GA engine 1 . 
[0033] The evaluation condition set for the GA engine 
1 at each stage is added from the lowermost to the top- 
most. Specifically, the evaluation condition for the first 
stage (the evaluation condition set for the GA engine 1 
at the first stage) is only "condition V, while the evalu- 
ation condition for the second stage is "condition 1^2 
("^" means "and"), which is a combination of 
the "condition 1" for the first stage and a new "condition 
2". The evaluation condition at the third stage 
is "evaluation condition 1'^2'^3". which is a combination 
of the "evaluation condition 1'^2" at the immediately pre- 
ceding condition and a new "condition 3". That is, the 
evaluation condition ^^2^ ...^ (final evaluation condi- 
tion) that consists of multiple conditions is divided step- 
wise, and one of the resultant evaluation conditions Is 
set for each stage, so that the conditions are added step- 
wise from the lowennost to the topmost stage. The 
number of conditions added at each stage is not neces- 
sarily one, and multiple conditions maybe added at the 
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same time. For example, while the evaluation condition 
at the first stage may be defined as "condition 1", the 
evaluation condition at the second stage may be defined 
as "condition 1^2^3\ 

[0034] To add the conditions to the GA engines 1 step- 
wise, a condition having a greater constraining force is 
located at a tower stage, and a condition having a lower 
constraining force is located at a higher stage. In other 
words, a condition which is rather a necessary condition 
is located at a lower stage, and a condition which is rath- 
er a sufficient condition is located at a higher stage. 
When optimization for the movement of a walking robot 
Is employed, the conditions that should be considered 
for the optimization are "the abdominal area does not 
touch the ground", 'Ihe robot does not fall", and " per 
step energy consumption Is low". In this case, the con- 
dition having a greater constraining force, such as "the 
abdominal area does not touch the ground", corre- 
sponds to "condition 1" at the iowemiost stage . The 
condition, "the robot does not fall", corresponds to a suc- 
ceeding "condition 2", and the condition for the highest 
level, " per step energy consumption is low", corre- 
sponds to "condition N" at the topmost stage (the least 
constraining force). 

[0035] When the optimization system is implemented 
by a standalone computer, a single CPU (Central 
Processing Unit) controls all of the functions of the N GA 
engines (calculators) 1, the (N-1) gene migration con- 
trollers 2 and the convergence determination unit 3. To 
increase the processing speed, a multi-processor com- 
puter or multiple computers connected by a network, 
such as a l^N, may be employed to carry out the opti- 
mization system. In this case, each CPU corresponds 
to a single GA engine 1 and a corresponding gene mi- 
gration controller 2, and the CPUs that perform parallel 
processing exchange data (genes) across a network, 
such as a LAN, or via a bus or another interface. The 
CPU that corresponds to the topmost GA engine 1 
serves as the convergence determination unit 3. Since 
GA engines 1 can be easily arranged in parallel because 
they perfomn GA calculations independently, the 
processing time required for optimization is reduced as 
the number of CPUs employed is Increased. Further, a 
comparatively small amount of data is required when 
adjacent GA engines 1 exchange a single gene, and the 
occurrence frequency is also not high. Therefore, a fast 
special line need not always be employed as the gene 
exchange interface. Here, when a well known distribut- 
ed GA is employed for a single GA engine 1 to perf onn 
more detailed and parallel processing, the processing 
speed can be further increased. 
[0036] Fig. 2 is a timing chart showing the evolution 
of generations. One generation is formed of a "GA cal- 
culation phase" and a "gene migration phase", and the 
phases are repeated as the generation evolves. In the 
"GAcateulation phase", the GA engines 1 at all the stag- 
es perform a parameter search at the same time and 
independently, in accordance with a well known genetic 



algorithm (GA). The GA engines 1 at the stages output, 
as a gene group PGn, parameter candidates that match 
the evaluation conditions that are individually set for the 
stages. Each gene of the gene group PGn is coded In 

5 accordance to a rule that is set as needed in accordance 
with the optimization problem. In orderto obtain a variety 
of a gene, it is preferable that the initial setup of the gene 
group PGn at each stage be prepared at random for 
each G A engine 1 . Either the same number of genes of 

10 the gene group PGn may be set for the GA engine 1 at 
each stage, or a different number of genes may be set. 
[0037] In the "GA calculation phase", the conver- 
gence detemnlnation unit 3 always observes the gene 
group PGN obtained by the topmost GA engine 1, and 

^5 determines whether optimization has been performed 
to satisfy the final evaluation condition "condition 
"[^2^ ... ^ N". Specifically, based on an evaluation func- 
tion that Is appropriately set so that a higher fitness Is 
obtained for a gene that matches the "evaluation condl- 

20 tlon A^2^ ... -^N", the individual genes of the topmost 
gene group PGN are evaluated. When the optimization 
for a specific generation K is satisfactory, an optimal pa- 
rameter Is output as the calculation result, and each GA 
engine 1 Is instructed to terminate the GA calculation. 

25 Thus, the optimization calculation for the optimization 
system is terminated. And when the optimization in the 
"GA calculation phase" is not completed satisfactorily, 
the "GA calculation phase" is shifted to the "gene migra- 
tion phase". 

30 [0038] In the "gene migration phase", each of the 
gene migration controllers 2 moves part of a gene group 
PGn at a lower stage to a higher stage, and moves part 
of the gene group PGn at the higher stage to the lower 
stage. In this specification, the movement of genes be- 

35 tween the gene groups PGn at the different stages Is 
called "migration." 

[0039] Fig. 3 is a flowchart showing the processing 
perfonned during gene migration. This processing Is 
performed independently by the gene migration control- 
40 lers 2, and an explanation will be given for the process- 
ing performed by the GA engine 1 at the n-th stage, 
which is the middle stage. 

[0040] At step 1 , a check is performed to determine 
whether a higher migration timing has been reached, i. 

45 e., the timing reached for the movement of a part of a 
gene group PGn at a stage to the immediately higher 
stage. This timing may be, for example, a fixed timing 
of every twenty generations, or may be detemriined by 
the selection of a constant rate at each generation. 

50 When It Is ascertained at step 1 that the timing has not . 
yet been reached, program control skips the higher mi- 
gration process (steps 2 to 5) and advances to step 6. 
Since for the topmost stage GA engine 1 , there is no GA 
engine 1 at a higher stage, the higher migration process 

55 (i.e., the upward migration moving process and the proc- 
ess for receiving migration data from a higher stage) is 
not performed. 

[0041] At step 2, genes in an n-th gene group PGn 
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that are to be moved to a higher stage, i.e. , the migration 
of data to a higher stage, are determined. Specifically, 
the genes in the gene group are evaluated based on a 
predetennined gene selection method, and basically, 
from among the gene group, genes with relatively high 
evaluations are selected for migration or movement to 
the higher stage. A constant number of data are select- 
ed for migration, and the total number of genes in the 
gene group PGn is not changed during the evolution cal- 
culation. It is appropriate that the number of migrations 
should be detemnined at a ratio relative to the total 
number of genes. Generally, in a field of GA, several 
methods are used to select a gene having a high eval- 
uation value, and based on a proper method, a migration 
to a higher stage is detenriined. According to these 
methods, a gene having a high evaluation value is not 
simply determined in accordance with the descending 
order, but is selected stochastically based on the need 
that a variety of a gene set is maintained. The typical 
selection method is a roulette selection method, a rank 
selection method or a tournament selection method. For 
a standard GA, these methods are employed to select 
a parent gene for the preparation of a gene for the next 
generation, and In this embodiment, the same selection 
method is employed. 

[0042] At step 3, migration data associated with the 
migration to a higher stage are transmitted to the higher 
stage, i.e., the (n+1 )-th stage. That is, the migration data 
detennined at the n-th stage are transmitted to the 
(n+1)-th stage, as is indicated by an arrow a, and the n- 
th stage is set to the state wherein the reception of ex- 
changed migration data is awaited (step 4). As is indi- 
cated by an an-ow b In Fig. 2, when the migration data 
exchanged at the (n+1)-th stage are received at the n- 
th stage, the received migration data are inserted into 
the gene group at the n-th stage (step 5). 
[0043] Then , at step 6, a check is perfonned to deter- 
mine whether the migration data at the (n-1)-th stage 
are received at the immediately higher n-th stage. When 
the migration data are received (an-ow c in Fig. 2). pro- 
gram control advances to step 7 and the lower migration 
process (steps 7 to 9) is perfomried. Since there is no 
GA engine 1 below the lowemnost GA engine 1 , the low- 
er migration process (the process for moving migration 
data to a lower stage and the process for receiving mi- 
gration data from a lower stage) is not perfonned. 
[0044] At step 7, a gene to be moved to a lower stage, 
I.e., data migration to a lower stage, is selected from 
among those in the gene group PGn. Specifically, the 
genes in the gene group are evaluated based on a pre- 
determined gene selection method, and basically, a 
gene having a low evaluation value is selected as mi- 
gration data to be moved to a lower stage. The number 
of migration data to be moved to a lower stage is con- 
stant, and the total number of genes in the gene group 
PGn is not changed during the calculation of the evolu- 
tion. Further, It is appropriate that, for the first time, the 
number of migrations be determined at a ratio relative 



to the total number of genes. A well known method, such 
as an Inverse roulette selection method, an inverse rank 
selection method or an inverse tournament selection 
method, can be employed to detemnlne the migration 

5 data to be moved to a lower stage, and the selection 
rate can be employed by inverting it relative to the eval- 
uation value (so as to obtain a higher selection rate for 
a gene having a low evaluation value). 
[0045] At step 8, as Is indicated by an arrow d In Fig. 

10 2, the migration data for migration to a lower stage are 
transfen-ed from the n-th stage to the (n-1)-th stage, 
which is a lower stage. Instead of deleting genes as mi- 
gration data, as Is Indicated by an arrow c in Fig. 2, the 
migration data received from the lower stage are insert- 

15 ed into the gene group PGn at the n-th stage (step 5). 
[0046] Through this gene migration processing, the 
total number of genes In the gene group PGn at each 
stage Is unchanged. The movement of migration data 
to a higher or lower stage is synchronously performed 

20 by the higher and lower gene groups, and the same 
number of genes are exchanged. As for a middle stage, 
the upward movement/downward movement do not oc- 
cur atthe same time; the movement of a gene to a higher 
stage is performed in synchronization with the gene 

25 group at the higher stage, and the movement of a gene 
to a lower stage Is perfonned in synchronization with the 
gene group at the lower stage. 

[0047] In the optimization system using the stepwise 
evolution method, the lowermost GA engine 1 performs 

30 a parameter search based only on the simplest evalua- 
tion condition 1 , and outputs the gene group PG1 . The 
GA engine 1 Immediately above the lowemnost GA en- 
gine 1 perfonns the parameter search based on the 
evaluation condition (1'^2) obtained by adding new con- 

35 dition 2 to the condition 1 , and outputs the gene group 
PG2. Similarly, conditions are added stepwise as the 
stages of the GA engine 1 ascend, and parameter 
searches based on more complicated evaluation condi- 
tions are attempted. At a predetermined timing, the gene 

40 migration controller 2 moves the determined number of 
genes (migration of data) from a gene group PGn to a 
higher gene group PGn+1 in order, beginning with the 
highest evaluation value (step-up). A higher GA engine 
1 , which has accepted the migration data, perfonns an 

45 evolution process beginning with genes which obtain a 
reasonable gene evaluation. Therefore, since the space 
wherein it is assumed that an optimal parameter should 
be present can be limited while conditions are added 
stepwise, the probability of finding an optimal parameter 

50 can be increased. 

[0048] Further, at a predetennined timing, the gene 
migration controller 2 moves the determined number of 
genes from a gene group PGn to a lower gene group 
PGn-1 In order, beginning with the lowest evaluation val- 

55 ue (step-down). Upon receiving the migration data, the 
lower GA engine 1 reattempts a parameter search 
based on an evaluation condition simpler than the pre- 
ceding condition. This is because when a parameter 
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search based on a compound condition is difficult, a new 
local minimum In the vicinity of the gene group PGn-1 
should be quickly found, based on a simplified condition, 
and a gene should again be moved to the higher stage. 
The convergence determination unit at the topmost 
stage constantly observes the process to determine 
whether optimization has been satisfactory perfonmed, 
and when the optimization is satisfactory, outputs the 
highest optimal parameter as the calculation results. 
The optimization calculation performed by the whole op- 
timization system is thereafter terminated. 
[0049] As Is described above, since, In the evaluation 
environment wherein conditions are added stepwise, 
the optimization process is perfomried stepwise and 
parts of the gene groups PGn are mutually exchanged 
by adjacent stages, evaluation calculations consonant 
with the optimization levels of the gene groups PGn can 
be automatically and voluntarily perfonmed. Further- 
more, the parameter search for a gene group PGn at a 
higher stage is also efficiently performed, so that the bi- 
asing of genes can be avoided {the variety is main- 
tained). Therefore, even when a result has been trapped 
by a local minimum, the probability of an escape from 
the local minimum is dramatically Increased and the ev- 
. olution progress is more continuous, so that a favorable 
parameter can be quickly calculated even when the 
evaluation condition is complicated. 
[0050] Consider a case wherein it is difficult to ap- 
proach a local minimum (optimal parameter) , although 
it is near, in the parameter space in a high stage whereat 
the compound level is increased (a case wherein an ex- 
tra operation is required to reach the optimum parame- 
ter). In this embodiment, under the control of the gene 
migration controller 2, as a result, a retry loop Is fomried 
in which a gene that has been moved to a higher stage 
and can not be further evolved Is moved to a lower 
stage, is slightly corrected at this lower stage, and is 
then moved again to the higher stage. In tiiis retry loop, 
when the gene moved to a lower stage is slightly 
changed and Is moved again to a higher stage, the angle 
of the approach is changed, and as a result, the proba- 
bility can be increased whereat a parameter can be ob- 
tained while avoiding an extra operation. 
[0051] In addition, according to the embodimerit, as 
with other effects, variety can be maintained for a group. 
For a GA, the maintenance of variety is the only foun- 
dation requlredto guarantee a parameter search having 
a wide range. The migration of a gene that is generated 
or changed at a lower stage contributes greatly to the 
maintenance of variety within groups at higher stages. 
[0052] Furthemnore, when a condition having a great- 
er constraining force Is provided for a lower stage than 
is provided for a higher stage, a search for a final, opti- 
mal parameter can be efficiently perfomned. Generally, 
. the space wherein a parameter that matches a specific 
condition is present tends to be extended as the con- 
straining force of a provided condition is increased. 
Therefore, when a condition having a greater constrain- 



ing force is added stepwise to a lower staige, and when 
a parameter search at a higher stage is perfomned while 
taking Into account a global minimum obtained at a low- 
er stage, it can be expected that the parameter search 
5 at the higher stage will be efficiently performed. 

[0053] Figs. 4A and 4B are graphs for explaining the 
relationship between the evolution of the generation and 
the optimization results. Since the parameter space is 
dramatfcally extended as more complicated evaluation 
10 conditions consisting of multiple conditions are provid- 
ed, the result obtained by the conventional simple GA 
tends to be trapped by a local minimum (see Fig. 4A). 
On the other hand, it is apparent from Fig. 4B that, in 
accordance with the optimization method of this embod- 
15 iment, the evolution progress is continued and that a sat- 
isfactory optimal parameter can be obtained without be- 
ing trapped by a local minimum. 
[0054] Further, when an operator desires to add (in- 
sert), as needed, a new evaluation condition, while re- 
20 fen-ing to the optimization results, the optimization sys- 
tem in this embodiment need only add another GA en- 
gine 1 for which an additional evaluation condition is pro- 
vided. The position whereat the GA engine 1 Is inserted 
is detemriined based on the strength of the constraining 
25 force that Is related to the newly added evaluation con- 
dition. That is, when the constraining force of the condi- 
tion to be added is great, it is preferable that the GA 
engine 1 be added to a lower stage, and when the con- 
straining force of the new condition to be added Is low, 
30 it is preferable that the GA engine 1 be added to a higher 
stage. Therefore, a system providing excellent usability 
can be implemented that matches the actual approach 
employed for a parameter search used to resolve the 
optimization problem, and the work of an operator can 
35 be simplified and efficiently perfomned. 

[0055] In addition, a new condition may be added to 
a GA engine 1 located above a GA engine 1 that has 
been inserted. In tills case, it is expected that the speed 
for the convergence at a parameter will be increased, 
40 [0056] In this embodiment, an explanation has been 
given for an example wherein genes are moved be- 
tween the immediately adjacent gene groups PGN and 
PGn+1 (or PGN and PGn-1). However, the present in- 
vention is not thus limited. The present Invention can be 
45 applied for the movement of a gene while skipping a 
stage, such as when movements are made to every oth- 
er stage, and this migration form is also Included within 
the scope of the invention. 

[0057] Further, in this embodiment, an explanation 
50 has also been given for an example wherein the migra- 
tions are exchanged by adjacent gene groups. Howev- 
er, when the processing speed is more important than 
an improvement in the precision of the optimal param- 
eter through the use of a retry loop, a step-up process 
55 may be independently performed without a step-down 
process being required. It should be noted that a step- 
down process is useless when it is independentiy per- 
formed, and must be performed together with a step-up 
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process. 

[0058] A storage medium on which a computer pro- 
gram is stored that implements the optimization method 
using the stepwise evolution method may be supplied 
to a computer In this case, the objective of the present 5 
invention Is achieved when the computer reads the com- 
puter program from the storage medium and executes 
it. Since the computer program read from the storage 
medium carries out the innovative functions of the In- 
vention, the storage medium on which the computer pro- io 
gram is recorded constitutes this invention. An example 
recording medium to be used for the recording of a com- 
puter program can be a CD-ROM, a floppy disl<, a hard 
disk, a memory card, an optical disk, a DVD-ROM or a 
DVD-RAM. Further, the computer program that carries 
out the functions of the embodiment also includes those 
innovative functions by which the objective of the inven- 
tion is achieved. 

(Second Embodiment) 

[0059] Fig. 5 is a block diagram showing the configu- 
ration of a controller that incorporates an optimization 
apparatus that Is based on the stepwise evolution meth- 
od. A controller 1 0 comprises an optimization apparatus 25 
11 , which implements the optimization method of the in- 
vention, an I/O unit 12, and a simulator 13 for simulating 
a control target 20. 

[0060] The optimization apparatus 11 calculates an 
optimal control parameter for driving or controlling the 
control target 20, and employs the control parameter to 
control the target 20 via the I/O unit 12. Further, the op- 
timization apparatus 11 perfomis a re-evaluation based 
on the control results obtained via the I/O unit 12, and 
continues the optimization operation. If the control target 
20 should be destroyed by being directly controlled, or 
if an extended time Is required to obtain the control re- 
sults, the simulator 13 is employed to perfomn an eval- 
uation. 

[0061] An explanation will now be given for a case 
wherein a four-legged walking robot is employed as an 
example control target 20 and the walking pattern is au- 
tomatically generated. A feed forward neural network 
using a sigmoid function shown In Fig. 6 is employed to 
generate the angle of each joint for one cycle that is 
called a walk pattern. In this case, w denotes a walking 
cycle, t denotes an elapsed time, and TH1 to TH3 de- 
note the Joint angles of the walking robot. The connec- 
tion weight coefficient of the neural network is adjusted 
using the stepwisis evolution method, and an optimal 
walk pattern is generated. 

[0062] For evaluating the walk pattern, various eval- 
uation conditions can be employed, including a condi- 
tion having a great constraining force, such as "the ab- 
dominal area does not touch the ground" or *the robot 
does not fall" and a condition having a small constrain- 
ing force, such as "the walking distance Is far", "con- 
sumption energy is small" or "the size of a triangle 
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fomned by grounded feet is small". The evaluation con- 
ditions are allocated to the GA engines 1 in Fig. 1, so 
that the condition having the greatest constraining force 
Is provided for a lower stage. 

[0063] Fig. 7 Is a specific diagram showing the lower 
space (space defined by adjustment parameters PI and 
P2) defined when the evaluation condition "the abdom- 
inal area does not touch the ground" is allocated to the 
lowemnost stage. Several local minima for "the abdom- 
inal area does not touch the ground" are calculated 
through the evolution by the GA. Multiple local minima 
are present In the lower space, and may be located at 
non-related positions. The gene near the local minima 
is efficiently selected, and migrates to the higher stage 
for which the evaluation condition "the abdominal area 
does not touch ^ the robot does not fall" Is provided. At 
the higher stage, since the evolution of the gene award- 
ed a satisfactory evaluation can be performed for the 
condition "the abdominal area does not touch the 
ground", the probability the optimal parameter will be 
found can be Increased. 

[0084] In addition, a gene with a low evaluation value 
is accepted from the higher stage, and the parameter 
search Is again performed under only the simple condi- 
tion "the abdominal area does not touch the ground" . 
As the reason for this process, as is described above, 
when a parameter search under a compound condition 
is difficult, the conditions are united and simplified so as 
to quickly find a new local minimum in the vicinity of the 
pertinent gene and to again move the gene to the higher 
stage. 

[Advantages Of The Invention] 

[0065] According to the present invention, by using 
the genetic algorithm, a parameter search is independ- 
ently perfomned for multiple stages, and at a predeter- 
mined timing, part of a gene group Is moved between 
higher and lower stages. As a result, an evolution cal- 
culation consonant with the optimization level of the 
gene can be automatically and voluntarily performed. 
Further, the parameter search for the gene group is per- 
formed efficiently, and the biasing of the gene can be 
avoided. As a result, the probability of trapping by the 
local minimum is lowered, and the evolution progresses 
more continuously, so that a satisfactory parameter can 
be quickly calculated. 



Claims 

1 . An optimization system, which employs a genetic 
algorithm to calculate an optimal parameter that 
matches an evaluation condition consisting of mul- 
tiple conditions, comprising: 

multiple calculators, provided at multiple stag- 
es, from the lowemnost to the topmost, for em- 
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ploying a genetic algorithm to output, as gene 
groups, parameter candidates that match eval- 
uation conditions that are individually set for 
said stages; 

controllers for moving specific genes between s 
gene groups at a lower stage and at a higher 
stage; and 

a detemninationunitfordetemrilningth© conver- 
gence of an optimization based on a gene 
group calculated by the calculator at the high- io 
est stage. 

wherein, in order to set said evaluation condi- 
tions for said stages, conditions are added stepwise 
from the lowermost to the topmost stage. 

2. An optimization system according to claim 1, 
wherein said evaluation condition consisting of mul- 
tiple conditions Is divided stepwise, so that said 
evaluation conditions can be set for said stages; 20 
and wherein a condition set at a lower stage has a 
greater constraining force than a condition set at a 
higher stage. 

3. An optimization system according to claim 1 or 2, 25 
wherein said controller permits adjacent calculators 

to exchange part of a gene group. 

4. An optimization system according to claim 1 or 2, 
wherein the individual genes of each of said gene 30 
groups are evaluated based on a predetermined 
gene selection method; and wherein, of a specific 
gene group, a gene with a relatively high evaluation 

is moved to a gene group at a higher stage. 

35 

5. An optimization system according to claim 4, 
wherein, while moving a gene to a higher stage, 
said controller receives a gene from said higher 
stage and inserts said received gene into said spe- 
cific gene group. 

6. An optimization system according to claim 4 or 5, . 
wherein said controller evaluates part of said gene 
group based on a predetennined gene selection 
method, and moves a gene with a relatively low 

. evaluation to a gene group at a lower stage. 

7. An optimization system according to claim 6, 
wherein, while moving a gene to a lower stage, said 
controller receives a gene from a lower stage and so 
inserts said received gene into said gene group. 

8. A controller that employs an optimization system 
according to one of claims 1 to 7 to calculate an op- 
timal control parameter and to control a target ss 
based on said control parameter. 

9. An optimization method, which employs a genetic 



algorithm to calculate an optimal parameter that 
matches an evaluation condition consisting of mul- 
tiple conditions, comprising: 

a first step of dividing, stepwise, said evaluation 
condition consisting of multiple evaluation con- 
ditions, of setting said evaluation condition for 
each stage from the lowemnost to the topmost, 
and of employing a genetic algorithm to Inde- 
pendently calculate, as gene groups, parame- 
ter candidates that match said evaluation con- 
dition at each of said stages; 
a second step of moving specific genes be- 
tween gene groups at a lower stage and a high- 
er stage; and 

a third step of detemnining the convergence of 
the optimization based on a gene group that 
matches the evaluation condition at the highest 
stage. 

10. An optimization method according to claim 9, 
wherein a condition set at a lower stage has a great- 
er constraining force than a condition set at a higher 
stage. 

11. An optimization method according to claim 9 or 10, 
wherein, at said second step, part of a gene group 
is exchanged by adjacent gene groups. 

12. An optimization method according to claim 9 or 10, 
wherein the optimization method further comprises 
a step of: 

evaluating individual genes of each of said 
gene groups based on a predetennined gene 
selection method, and moving, between specif- 
ic gene groups, a gene with a relatively high 
evaluation value to a gene group at a higher 
stage. 

13. An optimization method according to claim 12, 
wherein said second step includes a step of: 

while moving a gene to a higher stage, receiv- 
ing a gene from said higher stage and Inserting 
said received gene into said specific gene 
group. 

1 4. An optimization method according to claim 1 2 or 1 3, 
wherein said second step includes a step of: 

evaluating genes of said gene group based on 
a predetermined gene selection method, and 
moving a gene with a relatively low evaluation 
value to a gene group at a lower stage. 

15. An optimization method according to claim 14, 
wherein said second step includes a step of: 
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while moving a gene to a lower stage, receiving 
a gene from a lower stage, and inserting said 
received gene Into said gene group. 

16. A program that is executed by a computer con^- 
sponding to a calculator at the lowest stage and that 
executes an optimization method, whereby an eval- 
uation condition consisting of multiple conditions is 
divided stepwise, whereby the thus obtained eval- 
uation conditions are set for calculators provided at 
stages so that stepwise said evaluation conditions 
can be added from the lowermost to the topmost 
stage, and whereby said calculators employ a ge- 
netic algorithm to Independently calculate, as gene 
groups, parameter candidates that match said eval- 
uation conditions at said stages, said optimization 
method comprising: 

a first step of evaluating individual genes for 
each of said gene groups based on a predeter- 
mined gene selection method, and of moving, 
between specific gene groups, a gene awarded 
a relatively high evaluation value to a gene 
group at a higher stage; and 
a second step of receiving a gene from said 
higher stage, and inserting said received gene 
into said specific gene group. 

17. A program that is executed by a computer corre- 
sponding to a calculator at the topmost stage and 
that executes an optimization method, whereby an 
evaluation condition consisting of multiple condi- 
tions is divided stepwise, whereby the thus obtained 
evaluation conditions are set for calculators provid- 
ed at stages so that stepwise said evaluation con- 
ditions can be added from the lowemnost to the top- 
most stage, and whereby said calculators employ a 
genetic algorithm to independently calculate, as 
gene groups, parameter candidates that match said 
evaluation conditions at said stages, said optimiza- 
tion method comprising: 

a third step of evaluating individual genes for 
each of said gene groups based on a predeter- 
mined gene selection method, and of moving, 
between specific gene groups, a gene awarded 
a relatively low evaluation value to a gene 
group at a lower stage; and 
a fourth step of, while moving said gene to said 
lower stage, receiving a gene from said lower 
stage, and inserting said received gene Into 
said specific gene group. 

18. A program that is executed by a computer con-e- 
sponding to a calculator at the middle stage and that 
executes an optimization method, whereby an eval- 
uation condition consisting of multiple conditions Is 
divided stepwise, whereby the thus obtained eval- 



uation conditions are set for calculators provided at 
stages so that stepwise said evaluation conditions 
can be added from the lowemriost to the topmost 
stage, and whereby said calculators employ a ge- 
5 netic algorithm to Independently calculate, as gene 
groups, parameter candidates that match said eval- 
uation conditions at said stages, said optimization 
method comprising: 

10 a first step of evaluating individual genes for 

each of said gene groups based on a predeter- 
mined gene selection method, and of moving, 
between specific gene groups, a gene with a 
relatively high evaluation value to a gene group 

15 at a higher stage; 

a second step of receiving a gene from said 
higher stage, and inserting said received gene 
Into said specific gene group; 
a third step of evaluating individual genes for 

so each of said gene groups based on a predeter- 

mined gene selection method, and of moving, 
between specific gene groups, a gene with a 
relatively low evaluation value to a gene group 
at a lower stage; and 

25 a fourth step of, while moving said gene to said 

lower stage, receiving a gene from said lower 
stage, and Inserting said received gene into 
said specific gene group. 

50 19. A program according to one of claims 16, 17 and 
18, wherein a condition set at a lower stage has a 
greater constraining force than a condition set at a 
higher stage. 

35 20. A computer-readable recording medium on which a 
program according to one of claims 1 6, 1 7 and 1 8 
is stored. 

21. An optimization apparatus according to one of 
40 clainns 1 to 7, wherein, when a new evaluation con- 
dition is to be added, a new calculator is inserted 
Into an appropriate position among said multiple 
calculators; and wherein said evaluation condition 
set for said new calculator includes said new eval- 

45 uatlon condition. 

22. An optimization apparatus according to claim 21 , 
wherein said new calculator includes an evaluation 
condition set for a calculator lower than said new 

50 calculator. 

23. An optimization system according to claim 2A or 22, 
wherein, when said new evaluation condition is to 
be added for said new calculator, said new evalua- 

55 tion condition is also added to a calculator higher 
than said new calculator. 
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FIG, 3 
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FIG. 5 
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FIG. 7 
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